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ABSTRACT 

research concerned primarily with the relationship of cognitive 
abilities to learning are summarized. The major purpose of this 
research was to develop theorems of instruction related to the 
interaction of task variables and individual difference variables and 
to develop them in a manner relevant to the instructional designer's 
task. The studies focused on the relationship of cognitive abilities 
to the learning of concepts and rules and to the learning of an 
imaginary science of "Xenograde systems." The goal was to establish a 
theoretical and methodological continuum from simple concept 
learning, through the learning of a complex system of concepts and 
rules, to a set of instructional design procedures which permit 
transfer of this knowledge into practice. On the basis of the studies 
a model for research in this area was recommended, cognitive 
processes relevant for concept and rule learning were defined, and a 
hypothesis construction model of simple concept learning was 
outlined, along with proposed theoretical considerations for more 
complex concept learning and specific recommendations for 
instructional design utilizing differences in intellectual abilities. 
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INTRODUCTION 



T 110 objectives of this program of research were summarized in the 
abstract of the initiating proposal, submitted October 12, 1967: 

The psychological investigation of human learning has been 
limited in at least two directions; first, the class of tasks 
studied has been too narrow and proscribed to permit ready gener- 
alization to educational settings; and second/ behavioral psycholo- 
gists have failed to integrate the data from the psychometric studies 
of individual differences in learning and thinking into their theories. 
Recent developments in cognitive psychology promise to narrow the 
gap between the study of learning and the study of individual dif- 
ferences. The new emphasis on individualized instruction in this 
country, along with the introduction of computer technology into 
the educational process, provides the opportunity to narrow the gap 
between the study of human learning in the laboratory and in practical 
training and educational problems. 

Questions of sequencing in a hierarchical task will be studied/ 
using an imaginary science task which parallels the hierarchical 
structure of concept and rule learning in science and mathematics. 

A version of this task which employs an inductive or discovery 
approach will also be developed and investigated. The interaction 
of cognitive and other traits with different degrees of learner 
control and with expository versus inductive presentation will be 
explored. The interactions of cognitive abilities with treatment 
conditions in learning concepts and rules ,will be studied using 
laboratory concept tasks both on and off the computer as appropriate. 
This set of activities provides the link between learning theory and 
individual differences on the one hand and between instructional 
theory and instructional design on the other. 

In the original proposal, stress was placed on the need that 
psychological research be relevant to the "state of the art" in instructional 
design., The instructional design model current then, developed and used by 
the Computer-Assisted Instruction (CAI) Laboratory for contract curriculum 
development funded by publishers, industry, and government, was described 
in the original proposal. This model represents a pragmatically oriented 
approach to instructional design and development, having the flavor of 
systems, analysis. It permits quality control and management of curriculum 
development. The need to base the instructional designer’s decisions on 
empirically validated, theoretical propositions rather than solely on the 
basis of intuition and trial and error was stressed. A long range goal of 
this research program (which was originally conceived to extend more than 
two years) was t.o develop those aspects of a theory of instruction related 
to the interaction between task variables and individual difference varia- 
bles and to develop them in a manner relevant to the instructional designer 1 s 
task. 
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A continuum was conceived for this program wherein the instructional 
design model marked the most applied extreme and represented the actual tasks 
an instructional designer had to perform, the approximate sequence of the 
tasks, and their interrelationships. This model was expected to evolve from 
research conducted on this project and on other more applied projects in the 
CAI Laboratory. The more basic end of the continuum was marked by the use of 
laboratory tasks familiar to the experimental psychologist. ' This allowed the 
research to be anchored at one end at least with relevant portions of the great 
body of data, methodology, and theory in human concept and rule learning, and 
limited forms of problem solving. 

In an attempt to bridge applied instructional design activities and 
concept learning research, a CAI program was developed and evolved to teach 
''The Imaginary Science of Xenograde Systems. This learning task ties into 
the instructional design model by virtue of its design. It was designed using 
the steps and producing each of the products prescribed by the model . In par- 
ticular, the task has a hierarchical structure wnerein each* node of the hierarchy 
is a performance objective as well as a concept or. rule. Learning the rule 
could hopefully be related to findings in the more usual concept learning studies. 
The Xenograde task, however, also permitted empirical study of sequencing, in- 
dividualizing techniques, and other problems known to be of primary concern to 
the instructional designer. 

Research studies conducted under this contract thus can be classified 
under either the use of the Xenograde task or the use of more conventional 
laboratory tasks. , A third category is the instructional design model, its 
evaluation, and the, extent to which the research studies influenced it. 

The purpose of this report is to summarize the/ research and other 
activities conducted under this contract and to evaluate the extent to whicl 
the strategy of bridging between applied and basic concerns was successful. 



NOTE. — A summary of the research studies and other activities relevant to the 
objectives of this research program is found in Table 1. The table is broken 
into Categories I, II, and III, which represent (in the order of II, I, III) 
the continuum described above. These headings refer to: (I) research using 

the Xenograde task, and (II) instructional design and CAI. Category III sum- 
marizes concept research and other laboratory tasks. These three categories, 
with their roman’ numerals , also designate the three main divisions of this 
report. An evaluation chapter follows Section III. 



SECTION 



I 



STUDIES RELATED TO THE USE OF THE XE NOGRADE PROGRAM 



Aptitude Interactions with Expository op Discovery Treatments 

Contrary to over- optimistic hopes about the ease of conducting 
studies of human learning using a real-time CAI system, the problem of 
obtaining clean data v;as enormous. Loss of data due to program and hardware 
bugs, and proctor and operator error, are added to the problems of subject 
attrition and clerical error whicii plague the researcher. The complexity of 
program development and data analysis, using the c'.rly CAI languages ■ and systems, 
sometimes added weeks to the time required to complete studies instead of 
facilitating data collection. These early problems made it necessary to repeat 
every Xenograde study at least once, except these of Merrill (1970) and Bunder- 
son and Hansen (1971) . 

As programs and procedures became better and more familiar, these 
problems v;ere reduced, and some of the early promise of CAI was realized. The 
use of the 1500 APL system greatly alleviated the programming and data collec- 
tion problem so that at the end of the project, studies were sometimes run with 
great speed and rapid collection, sorting, and data analysis. 

The first Xenograde study listed dealt with a simulated version of 
Xenograde in which students input parameter values of their ovm choosing and 
studied the resulting Xenograde display. This was the only early Xenograde 
study that v/as never replicated. Such learner-directed manipulation of the 
parameters of a simulation enables students to discover" for themselves the 
relationships produced by the simulation model. The original pilot study made 
it clear, however, that simulation is inappropriate as a means of discovering 
concepts and rules for the first time in unfamiliar material, at least for 
subjects drawn from education courses. Simulation may be advantageous for 
integrating concepts and rules learned previously, testing in a more complex 
and life-like situation, demonstrating complex interactions, or generating 
example stimuli for expository instruction. The implications of this pilot 
study and other Xenograde studies were presented at a conference on computers 
in physics and mathematics education in August of 1970 (Bunderson, 1971) , 

Another problem with this initial simulation v;as its inordinately 
slow response time due to the clumsy calculation algorithm using fixed-point 
arithmetic in the counters of the Coursev/riter II language. Further studies 
using simulation models to drive Xenograde displays v;ere planned., and to this 
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end, a floating-point arithmetic function (Smith et al., 1970) and a set of 
plot functions (Wheaton et al., 1970) for producing graphical displays on 
the cathode ray tube of the IBH 1500 system were developed. It was not possi- 
ble to conduct such studies before the end of this contract, but the functions, 
in particular the algebraic function, have proved very valuable and have been 
disseminated among users of IBii 1500 equipment. 

A series of four studies was conducted which examined tne possible 
interactions of general reasoning, inductive reasoning, and associative memory 
with rule-example (ruleg or expository) vs. example only (discovery) instruc- 
tional treatments. The first tv;o studies were fraught with numerous problems 
and were considered pilot studies which led to important revisions in the 
Xenograde program and to hypotheses that were ultimately tested in later studies . 
The last two replications are reported in Technical Report Uo. 3. The first 
of these two pilot studies led to abandoning the group which used simulation 
with no rules or examples. 

The second pilot study used the ruleg vs. example-only treatments , 
and it produced results which were quite influential, both directly and indirectly 
on later studies. In this study, 59 students from science education classes at 
The University of Texas at Austin participated, and 51 completed all cognitive 
tests and the Xenog program. The battery of cognitive tests was selected from 
the Kit of Reference Tests for Cognitive Factors (French, Ekstrom, & Price, 

1963) and included two tests for each of the factors of Induction, Associative 
iiemorv, and General Reasoning. The Induction and Reasoning factors collapsed 
into one reasoning factor., 

On the basis of this pilot work, several conclusions were reached. 

First, the discovery group required more examples to learn the science, but 
there were no differences between the groups on a posttest, a retention test, 
or a transfer test. Second, memory ability was found to be highly related to 
performance when statements of the rules were given, but this was not found 
when subjects we re required to infer their own rules. This interaction was 
disordinal; i.e., the regression lines on memory for the two treatment groups 
crossed not far from the mean on memory score. In addition to these results, 
the pilot study also revealed that the amount of time required to learn the 
task was excessive and that several of the rules were too difficult. Conse- 
quently,. the task was revised. A new task analysis procedure was used for 
the first time. The basic structure of the science was maintained, but several 
of the laws which governed the relationships of the system v:ere changed. The 
verbal statements of tme rules were simplified and the examples were selected 
so that only integer values, rather than decimal fractions, were shown. Hypothe- 
ses about the disordinal interactions with memory were generated which ulti- 
mately led to a study soon to be published (Bunderson & Hansen, 1971) . . 

A second study was conducted to test the feasibility of the revised 
version of the Xenograde program. In this study, B0 subjects from science 
education classes at The University of Texas at Austin were run under the same 
design as described above. Unfortunately, usable data were obtained on only 30 
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subjects. Tne results of this effort are similar in several respects to the 
first pilot study. The discovery group again required a greater number of 
examples to learn the science.. In this study, however, reasoning ability was 
found to interact with the treatments. The number of examples required by 
the discovery group was highly related- inversely, to reasoning ability. This 
was not the case with the group wnich was presented with statements of the rules. 
The inverse relationship between memory and performance in the discovery group, 
which was found in the study conducted before revision, was not replicated. 
Instead, memory was found to facilitate performance in the discovery group, as 
indicated by number of examples, rather than hinder it. This indicated that 
revision nad somehow substantially altered the role of memory. 

In the final study of this series , 53 students from science education 
classes at The University of Texas at Austin completed all factor tests, the 
Xenog program, and retention and transfer tests. This study was the same in all 
respects to the one just described, but it was regarded as a replication because 
of the small N in the previous study. The results were a replication of those 
in the previous study. The discovery group required a greater number of examples 
to learn the science, and the number of examples required was found to be highly 
related to reasor/lng ability. The positive relation of memory to performance 
was again observed. Tnese results and their implications to instructional 
design were reported in papers presented at the annual meeting of the American 
Educational Research Association in Los Angeles (Bunclerson, 1969a) and at the 
annual meeting of the American Psychological Association in Washington, D.C. 
(Bunder son, 1969b) . 

The curious reversal in regression slopes for memory before and after 
revision led to another study. This reversal occurred only in the discovery 
group. Before revision, the slope of tne regression line was positive in this 
group, showing that subjects nigh on memory required more examples to learn 
(i*e. r learned less efficiently). Following revision, the reverse was true: 
subjects high on memory required fewer examples to learn. Two variables which 
were changed in the course of revision were the availability of past instances 
(before revision, subjects could record previous instances on a worksheet) and 
complexity of the displays (irrelevant information was reduced during revision) . 
Using the discovery treatment only, these two variables were manipulated in a 
2x2 factorial design by reintroducing irrelevant information into the example 
displays to produce complexity and by manipulating availability through the 
presence or absence of a worksheet for recording examples • 

This study pernaps comes closer to cross -validating results between 
the Xenograde task and the concept learning studies than any conducted during 
this program. The facilitatiye effects of memory aptitude on number of ex- 
amples for learning the revised Xenograde task had its counterpart in number - 
of-trials for learning concepts in studies by Blaine, Dunham, and Pyle (1963) 
and Blaine and Dunham (1970) . In a study by frJicklegren and Cohen (1962) , how- 
ever, subjects were allowed different sizes of external memory,*’ that is, notes 
they could write about previous instances. In this study, greater '’external 
memory" led to poorer performances, corresponding co the positive regression of 
number of examples on memory found before revision in Xenograde, wuen a record 
of previous examples was kept.. 
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This Xenograde study used 110 undergraduate education majors from 
The University of Texas at Austin. It was found that the reintroduction of 
availability did indeed reverse the slopes of the regression lines from nega - 
tive to positive, both with and without complexity. The effect of complexity 
was not only to reduce the facilitating effect of associative memory <i Xa ) 
without availability for subjects high on Ha, but. also to reduce the debili- 
tating effect of 1-la in the presence of availability of subjects high on Ha . 
There was no apparent effect of complexity on the performance of subjects low 
on 1-ia. 



Disappointingly, these apparent disordinal interactions, produced 
by conscious manipulation of instructional variables, did not achieve 
statistical significance. A number of disordinal interactions of performance 
measures on Reasoning Ability were found to be statistically significant. 
However, ^ese interactions had not been predicted. These results are reported 
in Bunders j>a and Hansen {1971) . 

Tile strong relationship of Reasoning Ability to Performance in learn- 
ing Xenograde was the subject of the dissertation study by Herrill (1970). He 
hypothesized that the reasoning factors represented facility in certain informa- 
tion processing skills which enabled subjects high on this ability to focus more 
rapidly and accurately on the relevant aspects of example -only displays. 

Previous Xenog studies in this series had shown that the introduction 
of rules reduced the apparent contribution of Reasoning Abilities to nothing. 

An instructional designer may still wish to use a discovery sequence, yet still 
desire to reduce the difficulty encountered by subjects low on Reasoning Ability 
Herr ill hypothesized that the presentation of performance objectives would in- 
troduce a focusing effect which would reduce the slope of the regression of 
performance on Reasoning Ability. In effect, the instructional variable v/ould 
substitute an external focusing effect for the focusing generated by subjects 
high on Reasoning Ability. 

. Subjects were dravm from introductory educational psychology courses 
at The University of Texas at Austin, and a total of 131 completed all phases 
of the study. Both the availability of rules and of objectives were manipu- 
lated independently. It v;as found that objectives did signif icantly reduce 
the number of examples required to learn the task. This effect was not as 
strong as the facilitative effect of using rules. This significant reduction 
in number of examples was no stronger for subjects low in Reasoning than for 
those high on this ability. For test- item-latency, however, subjects low on 
Reasoning profited from the availability of objectives more than their brighter 
fellows did (whoK it must be added, had less to gain) . 

. Performance objectives are one of the most important products. of 
the instructional designer's art. Herr ill's study, taken as a whole, snowed 
that as an instructional variable, objectives nave orienting and organizing 
effects which dispose students to attend to, process, and structure relevant 
information in accordance with the given objectives. This facilitating effect 
is especially helpful to students lower on Reasoning Ability. 
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While aptitude x treatment interactions were the major concern of 
these studies , it is interesting to note what the results have to say about 
the discovery-learning hypothesis, vis., that learning by discovery leads to 
greater retention or transfer. Retention and transfer measures were taken 
in each Xenograde study. The transfer measure required subjects to infer 
several totally new rules , given new examples — a process presumably similar 
to the process they practiced during learning — but in no case was the dis- 
covery learning hypothesis supported. There was either no difference between 
the two groups or a difference in favor of the rule^example group. This was 
true even when the example -only group had the advantage of objectives to 
study. Contrary to most studies involving discovery learning, both groups 
were brought to the same criterion on the ijosttest by means of individualized 
branching in the CAI program. Tnis resulted in more time and in the exposure 
to significantly more examples by the discovery group but no greater and, at 
times, inferior performance on retention and transfer. Students loiter on 
reasoning and memory abilities had considerably more difficulty with the 
discovery treatment than with the expository presentation. 

Those who favor the discovery hypothesis may argue with our opera- 
tional definition of discovery or with the pernaps unusual motivational 
aspects of the Xenograde task. This may not correspond to their definition 
of discovery, until someone is able to define better what is meant by dis- 
covery and to locate the source of any supposed advantage, the instructional 
uesigner must be wary of abandoning the powerfully -effective tool of well 
designed rule-example presentations, especially if he is dealing with popula- 
tions heavy on the lower ends of the ability scales used in these studies. 

Another approach to one aspect of what might be meant by discovery 
learning is through investigation of learner control vs. program control of 
instructional sequence and other variables. Two Xenograde studies were con- 
ducted to investigate the effects of mainpulating the sequence of rules in 
the Xenograde learning hierarchy. In both of bhese studies, only the rule- 
example version of the program was used. In the first study, the subjects 
were 118 students from introductory educational psychology courses at The 
University of Texas at Austin. Since only 49 completed the first one, it 
could be regarded only as a pilot study. It was replicated v/ith minor modi- 
fication, using 176 students from introductory educational psychology courses, 
152 of whom completed the study. 

The basic rule-example treatment was augmented by a representation 
of the hierarchy of rules which constituted the Xenograde science. Using this 
hierarchy as the basis for defining alternate sequences, an index of sequence 
was defined, as follows: The index was 1.0 when the sequence was in the 

perfect hierarchical order (that is, from the lowest order rule to the 
highest) . The index was .5 when an essentially random sequence of rules v;as 
taken? and the index was 0.0 v?hen the reverse sequence (top to bottom of the 
hierarchy) was taken. While there are several variations among treatment 
groups used in this study, only two juasic variations are reported here. One 
group was assigned to different sequence conditions from 0.0 to 1.0 and vrere 
led through sequences by the CAI program. Another group was shown the repre- 
sentation of the hierarchy, and each student was ailov/ed to choose his own 
sequence. 
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The principal findings were that (except for the 0.0 sequence) 
students in the learner-control groups did better when they chose an idiosyn- 
cratic sequence than when they chose the 1.0 sequence. Motivational effects 
were postulated to be at the root of this finding. On the other hand, stu- 
dents assigned randomly to different sequences did poorly when the sequence 
was scrambled and did progressively better as the sequence approached an 
index of 1.0, where they did significantly better than students wno chose 
a sequence of 1.0. 

It was found that the inductive reasoning factor v;as highly related 
to success in the forced group when the sequence was scrambled but was not 
related when it approached 1.0. 

Mean posttest score for students under program control was signifi- 
cantly better than for learner control, despite negative sequence effects. 
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SECTION 



I I 

INSTRUCTIONAL DESIGN AND CAI IMPLICATIONS 



The activities in this section, as indicated in Table 1, relate 
to computer-assisted instruction more generally as well as to instructional desic 
Previously mentioned were the technical reports listed in the table under 
II.B, which document special-purpose author language functions. These ex- 
panded considerably the answer processing , display, and simulation capabilities 
of the IBM 1500 system. 

The papers listed under A in Table 2 are primarily concerned with 
various aspects of instructional design or of the implications of aptitude 
x treatment research findings to instructional design. 

The instructional design model provides a conceptual structure for 
classifying the products of instructional design in a manner highly related to 
the production of documentation products as well as final program materials. 

The intermediate and final products of instructional design are outlined in 
an organized scheme and are discussed by Bunderson (1970a, 1971) . 

Technical Report No. 2 is a ’’case study 1 ' of instructional design and 
documentation and is the manual for the Xenograde program, written to reveal 
the various design products prescribed by the model. The manual is slanted 
toward a supposed audience of researchers rather than potential educational 
users due to the nature of the Xenograde program. This second report thus 
attempts to convey some of the rationale behind linking instructional research 
to carefully rationalized and carefully documented instructional design of an 
experimental task, as well as demonstrate how such a procedure might aid in 
accomplishing the linkage of research to relevance — of science to engineering. 

The papers presented at the annual meetings of the American Educa- 
tional Research Association and the American Psychological Association 
(Bunderson, 1969a, 1969b, 1970b) concerned the relevance of aptitude x treat- 
ment interactions to instructional design. In these papers, an increasing 
tone of skepticism was expressed toward the practical value of disorainal 
interactions between treatments and aptitudes. 

The methodological model for our research during the course of this 
project came to resemble that discussed by Cronbach and Snow (1969) . Given 
two or more separate instructional treatments, the argument goes, it may be 
possible to find one or more aptitudes (broadly defined) which will interact 
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such that students lew on the measure of an aptitude may do significantly 
better in one of the groups tnan in the others , while for students high on 
that aptitude, the reverse may be the case. This interaction is observed 
by a regression analysis wherein the regression lines of performance on 
aptitude, calculated separately for each treatment, cross well within the 
range of the aptitude measure. Such a pattern of regression lines is termed 
a disordinal interaction. 

methodologically, this approach has much to be commended in research 
studies. It is assumed by Cronbach and Snow, however, that results of this 
sort can lead in a natural manner to improvements in instruction by assigning 
individuals to different treatments based on their aptitude scores. It is this 
assumption that is challenged in the three, papers cited above. 

Four interrelated reasons were given for this .skepticism: 

(1) The rarity of useful disordinal ' interaction, it is more 
common to find no interaction than othervh.se. When interactions are 
found, they are more likely to be ordinal interactions (regression 
lines cross outside the range of the aptitude, measures) than disordinal. 
When they are found to be disordinal, they often prove to be of no value 
relative to alternate assignment since the point of intersection of the 
regression lines follows so closely to an end of the aptitude range as 
to provide no hope for practical ■ instructional advantage. 

( 2 ) Disordinal interactions may not be sufficiently robust under 
even seemingly minor changes in the task or population. Revision of a 
task is the instructional designer’s most powerful tool. As the Bunder’' 
son and Hansen (1971) study indicates , revision may produce regression 
results partially predictable on the basis of an understanding of the 
variables being manipulated, but these modifications may produce quite 
unexpected and possibly more important interactions with other aptitudes. 

(3) Ceiling effect on the methodology of regression analysis . 
Successful instructional design enables all subjects to reach a high 
performance criterion. By design, there is almost no variance in post- 
test scores (for example) , allowing the variance to reappear in the 
number of examples seen or in the amount of time taken. Treatments 

in which there is sufficient variance- remaining in posttest scores to 
seek disordinal interactions may be in need of substantial revision, 
which introduces the robustness problem (described above) and which 
produces, if successful, a situation where regression analyses cannot 
be applied, at least not on the posttest score. 

(4) Payoff relative to further instructional design and revision . 

The payoff attainable through alternate treatment assignment based on a 

. disordinal interaction may be less than that attainable through revision 
of the single best treatment. In instructional design, there is probably 
no factor that produces more improvement for more students than the care- 
ful ful revision of a program based on detailed feedback of student responses, 
attitudes, and response times about specific details of an instructional 
program. 



It was proposed in the APA presentation by Bundercor. (1970) that, 
at least for the class of tasks and aptitudes studied in this project, a 
more fruitful approach would be to look at single-step regression lines 
rather than to seek disordinal interactions. If a strong regression exists, 
the instructional designer can ask himself why. He can introduce changes in 
the program to reduce that information-processing burden for the lov:-aptitude 
individuals. Hopefully, using the information -processing constructs developed 
through the rationale described in Section III, he can select — based on theory — 
instructional variables to manipulate during revision. The variables he intro- 
duces, in a CAI program at least, might be ’’micro-treatment variables applied 
adaptively within a branching CAI program rather than through the production 
of an entire alternate treatment (Bunder son, 1969b) . 

It was also suggested that the micro-treatment methodology and the 
analysis of regression patterns for single treatments lead more naturally to 
an optimisation methodology than to the methodology of regression analysis 
and macros treatments described above. In this approach, aptitude measures 
become parameters in optimization models of some type (which can be applied 
dynamically within CAI programs) . This thinking found more powerful expression 
in the laboratory research studies, which are summarized in Section III. 

The formulation of new information-processing constructs relevant 
to both aptitude tests and concept-learning tasks discussed below is seen as 
providing the constructs and construct-validation methodologies permitting 
the development of mathematical hypothesis-construction models of concept 
learning, if this evolving approach is successful, it may prove to have the 
strengths of the optimization approach described by Atkinson (1970) for in- 
structional decision-making and learning theory. Hopefully, it might also 
contribute some of the conceptual richness characteristic of the Guilford 
aptitudes tradition from which this project is an intellectual descendant. 

It should be recognized in evaluating the findings of this research 
project that we have restricted the investigation almost exclusively to cog- 
nitive aptitudes and to concept and rule-learning tasks. The subjects learn- 
ing process for these tasks occurs over a relatively snort period of time. 
Cronbach and Snow (1969) stress that disordinal interactions snould be sought 
in learning situations which occur over a longer period of time so that 
subjects can become attuned to the instructional treatments. Under long-term 
learning situations and by using noncognitive as well as cognitive aptitudes, 
it may be possible to justify the design of two or more macro-treatments and 
to assign individuals to alternate treatments for instructional gain. A task 
for the future is to apply the methodological approach and conceptual models 
developed in this project to longer term learning to determine whether or not 
it might have the same advantages found here . 

The paper by Merrill (1971) was written after he received the 
doctor of philosophy degree and had accepted a position at Florida State 
University. The algorithmic or information-processing analysis procedure 
which he describes was conceived during the series of Xenograde studies, 
however, and is described in preliminary form in Olivier (1970) and Merrill 
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(1970) . The information-processing analysis approach Merrill describes has 
its counterpart in tne methodology described in the following section for 
laboratory tasks. Merrill's paper is included in this report to complete 
an important conceptual symmetry between the parts of this project repre- 
sented in Table 1 . 

A few words must be said about the . importance of the instructional 
design model (which substantially evolved during the course of this project) 
to developments of national significance in CAI. The paper entitled :'Computer 
in Mainline Instruction” (Bunderson, 1970a) laid the foundation for an approach 
to the introduction of cost-effective CAI into junior colleges and other 
adult education institutions. This approach has found expression in major 
proposals to the National Science Foundation (NSF) submitted cooperatively 
by MITRE Corporation and The University of Texas CAI Laboratory. These pro- 
posals aim tov7ard the development and introduction of low-cost , market-oriented 
systems consisting of a marriage of television and computer technology on the 
hardware side and of curricula designed according to the instructional design 
model on the educational side. * An extension of the learner-control research 
and the instructional-design research initiated in this project has found 
continuing support through a five-year grant from the National Science 
Foundation for research in instructional design and authoring systems 
(Grant GJ 509 A, initiated June, 1963) . 
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III 



STUDIES RELATED TO THE USE OF LABORATORY TASKS 



A cursory glance at the list of studies appearing under the heading 
labeled III in Table 1 representative of the larger portion of effort in 
this project does not convey the evolutionary logic and interrelationships 
which existed among these seemingly diverse activities. The studies fall 
into clusters, indicated by the subheadings of A through E , with Category F 
representing extensions of the basic methodology beyond concept-learning 
tasks and cognitive aptitudes. Tni s section begins with a general overview 
of all studies listed under the heading labeled III in Table 1. Subheadings 
for Categories A through F then designate detailed reports and interpreta- 
tions of the various studies. 

The - fundamental ideas on which the series of studies was based are 
as follows (hereinafter designated as Propositions 1, 2, and 3) ; 

(1) The most critical step in understanding and predicting 
complex learning behavior comes through a careful and accurate analysis 
of efficient human information-processing strategies for that class of 
tasks, 

(2) Cognitive aptitudes relevant to performance on a class of 
tasks may be selected, and their interactions with treatments may be 
understood in relation to their relevance to the information-processing 
requirements of the task. 

(3) Experimental manipulations of task variables produce effects 
on task performance and on aptitude interactions understandable from 

the manner and extent to which these manipulations alter the information- 
processing requirements of the task. 

The clusters of studies designated A through F under III in Table 1 can be 
placed in context to the extent that they elucidated one or more of the 
Propositions 1, 2, or 3 in relation to concept-learning tasks and correspond- 
ing cognitive aptitudes. 

Clusters A, B, and C were concerned with multiple-category con- 
junctive concept problems. Such problems are characterized by the learning 
of a multiple response system to the values or combinations of values on the 
relevant dimensions. Prior analysis of this problem, had led to the defini- 
tion of two decision rules wnicn could form the basis for efficient information 
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processing strategies in solving these concept problems. Studies in Category B 
were concerned with the effect on task performance and aptitude interactions 
of manipulating an instructional variable , namely , information about and 
practice on one cr both of the decision rules. They relate most clearly to 
Proposition 3, and established the modest but important conclusion that 
experimental manipulations which produce no mean differences may nonetheless 
produce important differences in aptitude patterns. 

The second of these studies set out to accomplish more than the 
statement implies by separating the stages of learning in the multiple-category 
task and providing instruction on the two decision rules separately for dif- 
ferent groups. Based on this detailed analysis of the task, predictions were 
made relative to aptitude interactions. The complexity of the results indicated 
that further definition of both the information processing occurring in dif- 
ferent instructional treatments and of the aptitudes was necessary. Recogni- 
tion of this, difficulty was influential in leading to the methodological inno- 
vations of the studies in Category D and the theoretical considerations of 
Category E . 

The final study in this series was not an aptitude -treatment inter- 
action study. It relates to Propositions 1 and 3 and reflects a considerably 
advanced understanding of the interaction 1 between the strategy (decision 
rules) used by learners and the sequence of concept exemplars *.• The role of 
contiguity in concept identification, contrary to previous literature, was 
shown to be dependent on the learner strategy. VJhile it was not possible 
to follow up the implications of this study to the more instruction-oriented 
aspects of this program, the implications may be worthy of serious investiga- 
tion. The careful shaping of the structure and sequence of concept exemplars 
based on theoretical propositions derived from basic research and applied to 
information- processing analyses of complex school learning tasks may become 
a powerful instructional design technique (e.g», Tennyson, Wooley, & Herr ill , 
1970) . 



The study in Category C further established the conclusion that 
aptitude interactions may exist in spite of a lack of mean differences between 
treatment groups (Blaine & Dunham, 1970) . This study (Blaine & Dunham, 1971) 
showed also that the relationship of xaemory to performance could be manipulated 
by varying the availability of previous instances, although, as in the second 
study under Category B, the relationships are not easily interpretable. This 
study relates to both Propositions 2 and 3 and to the Xenograde study discussed 
above (Bunderson & Hansen, 1971) . 

The series of studies in Category A ..of III in Table 1 relates most 
directly to Proposition 1 and that part of Proposition 3 concerned with task 
performance rather than aptitude interactions. Prior experimental work and 
analysis of the multiple-category concept problem had led to the suggestion 
that there- may be two steps involved in the solution process (Overstreet & 
Dunham, 1969) * These two stages were designated as dimension selection and 
associative learning. In order to study the effects of task manipulation on 
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the two decision rules necessary to efficient performance in problems of this 
type, it is necessary to separate experimentally the dimension selection and 
associative learning stages. This was dene with increasing sophistication 
in understanding of and control over the students* use of these decision rules 
through the series of studies designed under Category A. In Overstreet* s 
dissertation (1970) the implications to mathematical models, such as that of 
Chumbley (1970) , and to the model developed as a result of the research j_n 
Category E were drawn. 

Although not employing aptitude measures, these studies were impor- 
tant both methodologically and conceptually to the evaluation of thinking 
about the aptitude treatment interaction problem. The methodological separation 
of the dimension selection and the associative learning stages was attempted 
in the second study in Category A. The refinement of thinking about the infor- 
mation processes involved in concept learning were fundamental to certain of the 
methodological innovations in the studies in Category D and were helpful toward 
the representation of important information-processing constructs in mathemati- 
cal model form (Category E) . 

Activities listed under Category D came to represent the most impor- 
tant conceptual and methodological contribution of this project to research 
and theory involving aptitude x treatment methodology. Using the increased 
sophisitication in information-processing analysis of concept-learning tasks, 
studies in this series produced a variety of new measuring instruments for 
both cognitive abilities and concept-learning problems, including non-spec if ied 
dimension problems as well as the multiple-category Tiroblem. Assuming that 
variance in performance on b oth relevant conventional ability tests and con- 
cept learning tasks could be accounted for by the same set of processing con- 
structs, studies in this series set out positively to define these constructs 
through a new methodological procedure and to use them powerfully in studies 
which integrate all three of the propositions listed above .. because of the im- 
portance of these concepts, extra space is given to them in this report,. 

Studies of this type can yield information-processing constructs 
which account for large portions of variance in complex concept- learning 
problems, and possess construct validity relative to important stages and 
decision strategies in concept learning. Such constructs and their operational 
linkages to data are prerequisite to the development of mathematical models 
of complex concept -learning behavior. The studies listed unaer Category E do 
not yet relate to Proposition 2, but they are in the mainstream of thinking 
on this project. This is so because they lead toward the incorporation of 
the information-processing constructs developed in the project at large in 
hypothesis-construction models of concept learning. Such models will require 
the addition of parameters to represent the aptitude process constructs shown 
to interact importantly with alternate treatments. 

Tile two dissertation studies listed under Category F extended the 
process-analysis aptitude treatment methodology of this project in two new 
directions. Host ambitious was the study by Ilollen (1970) , wao attempted 
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an information-processing analysis of learning from connected discourse. The 
position of adjunct questions was the task variable predicted to produce 
aptitude interactions with different memory abilities. Hollen attempted to 
develop a new process test for a hypothesized memory process and for predicted 
changes in the regression of performance scores on two -memory abilities due 
to the influence of adjunct questions on processing requirements. As was 
the case in most of our early Xenograde and concept studies, tne results were 
not wholly consistent with the predictions nor were they easy to interpret. 

The aptitude x treatment interaction problem in a new task domain seems 
tractable only through a difficult sequence of iterations between detailed 
task analysis, construct validation, and empirical observation. 

The dissertation by lieyers (1971) built on the foundation of research 
laid here on the multiple-category concept problem and examined the effect of 
anxiety, moderated by ego involvement, on cognitive aptitude x treatment 
interactions. 



l-tultiple-Categovy Conjunctive Concept Problems 

Multiple-category conjunctive concept problems are characterized 
by the learning of a multiple-response system to the values or combinations 
of values on the relevant dimensions. Prior experimental work and analysis 
of this type of concept problem has led to the suggestion that there may be 
two stages involved in the solution process (Overstreet & Dunham, 1969) . 

First, the subject must determine the relevant dimension or dimensions of the 
problem. Once the relevant dimensions have been determined, the subject must 
learn the responses which are associated with the different values displayed 
by the relevant dimensions. This interpretation suggests that different abili- 
ties might be related to the respective stages of the task. Further, treatment - 
manipulations may affect the relationship of abilities to performance only in 
terms of one stage of the solution process. 

Experiments were conducted to investigate the ' stages of learning 1 ' 
interpretation of multiple -category problems (Overstreet & Dunham, 1970; 
Overstreet, 1970). Those experiments employed multiple-category problems 
which were experimentally separated into the dimension-selection and response- 
learning stages. It was possible to specify two decision rules which subjects 
could use in determining the expropriate dimensions. Both rules necessi- 
tated a comparison of two instances and differed according to whether the 
comparison instances were from the same or different response categories. 

In one study, subjects were instructed on one of tne two rules 
and then received problems varying in the number of irrelevant dimensions 
and the number of values per dimension. Subjects were forced to solve the 
dimension selection phase by using rules for which they had been instructed. 

One of the. rules allows only the elimination of pairwise combinations of 
dimensions but not the elimination of any single dimension. The other rule 
permits the elimination of a given dimension without regard to any pairwise 
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combination it has with any other dimension. Thus, an interaction was predicted 
between rule-type and number of irrelevant dimensions in teie dimension selec- 
tion phase. On the other hand, neither of these variables should affect the 
response learning stage, while the number of values per dimension should have 
a great effect on response, learning performance. This outcome was predicted 
since the number of responses the subject must learn increases as the number 
of values per dimension increases. 

A total of 137 subjects from introductory psychology classes were 
run individually. The concept materials were presented at the cathoca ray 
tubes connected to the IbM 1500 system. The results supported the hypotheses, 
indicating not only that stimulus complexity variables differentially affect 
performance within the different stages, but also differential 1/ affect the 
efficient execution of information processing strategies. 

Procedural problems in Experiment I made it possible for subjects 
to reduce one information-processing rule to an artif actually simpler form. 
Experiment II, utilizing a modified procedure, was undertaken to replicate 
the previously-obtained differential difficulty of the information-processing 
rules and to clarify the interaction of rule-type and number of irrelevant 
dimensions. Each subject solved two problems without associative learning. 

The results of this second experiment replicated the basic relation 
between type of rule and difficulty which had been obtained in Experiment I. 

The number of dimensions by rule-type interaction obtained in Experiment I 
was not replicated in the second study, suggesting that a significant pro- 
portion of the subjects in the across-category rule conditions in Experiment I 
may have discovered and utilized the simplified form of this rule. I v 1o main 
effect for number of irrelevant dimensions was obtained in this second experi- 
ment. 



The results of these’ studies wore interpreted as casting doubt on 
the appropriateness of the sampling -process assumptions underlying current 
hypothesis-testing models of multiple-category concept attainment. Speci- 
fically, the results were interpreted as suggesting that a subject who is 
faced with an error that inf inns his hypothesis may be able to compare that 
hypothesis with the currently available stimulus and its feedback to derive 
information which would allow him to restrict temporarily the pool of dimen- 
sion pairs from which he will sample. 

The implications of this restricted sampling assumption, in two 
forms, were investigated with regard to the Chumbley (1970) model of multiple- 
category concept attainment. A further differentiation of Chumbley's aptitude 
interaction state into two states corresponding to (1) hypotheses containing 
only irrelevant dimensions and (2) hypotheses containing one relevant dimen- 
sion was suggested to account for the results of these studies. 
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Decision Rules and Concept Learning 

In addition to the investigation of the nature of the multiple- 
category problems, several studies were conducted in which the concern was 
the relationship of cognitive abilities to performance on such tasks under 
differing treatment conditions. One study (Dunham & Bunderson, 1969) was 
undertaken to determine the effect of instruction on the dimension selection 
rules described above and the relationship of cognitive abilities to concept- 
learning performance. One hundred thirty-six students from an Austin, Texas, 
high school were randomly assigned to two groups. A total of 69 subjects 
received instruction on the use of the dimension selection rules. The re- 
maining 67 subjects received instructions on the nature of the concept 
problem but were not given the additional rule instruction. All were then 
given a series of multiple-category concept problems. 

There were no differences in mean performance across problems for 
the two groups. However, the introduction of rule instruction did alter the 
role of the abilities in the solution of the concept problems. The perfor- 
mance of the group given rule instruction was highly related to a reasoning 
ability while the performance of the group without rule instruction was highly 
related to aa associative memory ability. Thus, students with a particular 
cognitive ability profile were successful under one condition, while those with 
a different profile were successful under the other condition. 

In the above study, it could not be determined whether the lack of 
mean differences was due to the inapplicability of the rules or to inadequate 
instruction on the rules. Consequently, a pilot study was conducted to deter- 
mine whether or not training subjects to use the rules would facilitate per- 
formance in a subsequent multiple-category problem. A group of 33 subjects 
received instruction on the use of the rules and were then presented with a 
series or -twining problems. Following this, the subjects were given a four- 
category conjunctive concept problem. A second group of 32 subjects did not 
receive the instruction and training on the use of the rules but received 
the same four-category problem as the training group. The results of the study 
indicate that training on the rules does facilitate subsequent concept per- 
formance. 



In the first aptitude x treatment interaction concept study, two 
decision rules were involved in the rule instruction. Since this was the 
case, an additional study (Dunham, 1969) was undertaken to determine if the 
use of one of the rules would require different abilities than those required 
by the other. The subjects were 68 undergraduates from introductory educa- 
tional psychology classes at The University of Texas at Austin. Instruction 
and traininy on the dimension selection rule involving a comparison of two 
instances from the same category were given to 37 subjects. The remaining 31 
were given the same instruction and training with the exception that it was 
with the rule involving a comparison of two instances from different cate- 
gories. The training for both groups involved specially-constructed problems 
which could only be solved using the rule for wnich the group was instructed. 
Following the training phase, the subjects were given the same multiple- 
category concept problem. 
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The results indicate that the rule involving a comparison of two 
instances from the same ca.tegory is the easier of the two rules when subjects 
were forced to use a particular rule. There were no differences in mean 
performance in the subsequent concept problem. However, there were differences 
in the relationship of abilities to performance on this problem for the two 
groups. Performance in tae condition with instruction on comparison of 
instances from the same category was substantially related to -a reasoning 
ability, while performance in the other condition was most highly related 
to an associative memory ability. Thus, the use of the ■ two decision rules were 
related to different abilities. 

In both of these studies, instruction and/or training on decision 
rules relevant to attaining solution in multiple -category concept problems 
did not effect differences in mean performance but did affect the relation- 
ship of performance to cognitive abilities. The treatments in these cases 
probably changed the information-processing requirements in the task as 
reflected by the differential correlations of the dependent variable with 
the ability measures. This would imply that different people, as repre- 
sented by different ability profiles, would succeed under the different 
treatments. Such differences, however, could balance out and not be de- 
tected if only the means were examined. 



Availability of Instances and Memory 

An additional study (Blaine a Dunham, 1969) was executed involving 
the same underlying theme as the above studies. It has consistently been 
shown that providing subjects with available past instances facilitates per- 
formance in concept-learning problems. This effect is usually interpreted 
as due to a reduction in the memory requirement of the task. If this is the 
case, the introduction of available past instances should effect a reduction 
in the relationship between tests of short-term memory abilities and per- 
formance in a concept-learning problem. 

The subjects in this study were 60 undergraduates from introductory 
educational psychology classes at The University of Texas at Austin. A 
battery of tests of short-term memory abilities was selected from Guilford* s 
Structure-of-Intellect model (Guilford, 1967) . The subjects were then pre- 
sented with a multiple-category concept problem, 30 of whom were given the 
problem by the regular method of anticipation, while the remaining 30 were 
presented the same problem but such that the just previous instance and its 
feedback were always available. 

There were no differences in the mean performance of the two groups. 
This result appears to be inconsistent with previous research. However, 
the number of available instances employed in this study was at a minimum, 
the smallest number ever used in such investigations. Although there was no 
difference in performance between the groups, the relationship between the 
short-term memory was substantially correlated with performance. Within 
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the group v?ith a past instance available/ the relationship was reduced. In 
fact, only one test retained a positive relationship with performance. This 
test has been shown to be related to “cognition" ability while all other 
tests have consistently been related only to "memory” ability. Thus the 
results of this study support the contention that making past instances 
available reduces the memory requirement of the concept task. In addition, 
the results are consistent with the previous studies in that an experimental 
treatment which does not effect differences in mean performance can alter the 
role of cognitive abilities in task performance. Such a result is made mani- 
fest only by an examination of the covariability of the dependent variable with 
measures of cognitive ability. 



Process Measures for Aptitude and Learning 

Given the limited amount of research that has been conducted, it 
may not be possible to present a general, integrated approach to the research 
question concerning the role of individual differences in concept learning. 

What is_ possible and necessary is to realize some of the problems involved 
in research of this type and to consider diff extent avenues of investigation. 

It appears that an appropriate place to begin any investigation of 
the relationships between abilities and concept learning would be an analysis 
of the task in terms of the processes that the learner must execute in order 
to attain solution. This would provide not only an understanding of the 
task itself, but also a basis for determining the ability requirements of 
the task. If the investigator is able to specify what processes must be 
executed, he should know what abilities would be relevant to performance in 
a learning task. He can then desion treatment options which are most likely 
to be instructionally effective or psychologically interesting, depending on 
his objectives. 

Therefore, analyzing the task in terms of thb processes required 
of subjects to attain solution of the cbndept-1 earning problems should pro- 
vide a better understanding of the ability requirements of the task. One study 
(Blaine, 1961) was designed and executed using a sample of 200 students from 
an Austin, Texas, high school. For this study, a number of nev; tests were 
developed in which the items were intended to require the subjects to execute 
a process which would be required in the multiple-category problems that the 
subjects had to solve. An attempt was made, on the basis of the analysis of 
a multiple-category problem, to develop tests which separately assessed all 
the processes required for solution of the concept problems. 

The experimental materials were administered in three-hour blocks 
on each of three consecutive days. The first day's materials consisted of 
a battery of known ability tests which are frequently used in testing for 
individual differences in learning research. On the second day, the subjects 
were given eight multiple-category concept learning problems in which measure 
of both dimension selection and response learning were obtained. The specially- 
developed tests were administered during the third day's session. 
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The known tests of abilities and the specially-developed tests 
have also been administered to a sample of undergraduate college students 
from introductory educational psychology classes at The University of 
Texas at Austin. The two batteries of tests were administered in two 
separate sessions. 

It was assumed that the data from these studies would provide 
information which is highly relevant in considering individual differences 
in learning. The relationship of the tests constructed to assess execu- 
tion of required processes to performance in the concept problems provides 
an evaluation of the analysis of the solution process in multiple-category 
concept problems: It was also assumed that the interrelations of these 

tests with the known ability tests would indicate the extent to which the 
known ability tests assess the execution of processes required by a speci- 
fic concept task. 

The process tests predicted performance on the concept problems 
as well as the aptitude tests. More importantly, the execution of this 
study underscored several problems which have given rise to the considera- 
tion of an alternative approach to the study of the relationships between 
cognitive abilities and performance on concept learning problems. 

Knowing what abilities are relevant does not necessarily imply 
that they can be adequately assessed. If, after analysing the task several 
abilities are shown to be relevant, the investigator is still faced with 
the problem of assessing an individual subject's capacity to execute the 
relevant processes. After this is accomplished, there is no guarantee that 
the tests of known cognitive abilities will be related to the specific 
concept -learning task. Absence of this relationship may be the case if 
differences exist in content between the task and the test or in the level 
at which the ability is assessed. This reasoning could lead to the extreme 
of having a unique set of tests for every possible learning task, which doe 
not appear to be feasible or appropriate. 

It seems it. is necessary to clarify the term "relationship 11 as it 
is used in the phrase "the relationship between abilities and concept 
learning." Traditionally, it has been interpreted to mean that the ability 
.as measured by tests of known abilities, was necessary in solving concept- 
learning problems. If, for example, Ability A has a lesser relationship to 
a concept-learning problem than Ability B, it would imply that Ability B is 
utilised more than Ability A in solving the task. This kind of interpre- 
tation v implies ..that known tests of abilities measure single, specifiable 
cognitive processes or that several tests of the same ability measure the 
same single, specifiable cognitive process. The results of these two 
studies showed that this is not the case. Most tests commonly used to 
define an ability factor contain. several specifiable cognitive processes. 
This indicates that the relationship between abilities and performance on 
a learning task may partially, be a function of the similarity of the cog- 
nitive processes employed to attain solution of a concept-learning problem 
and to perform adequately on an ability measure. Allison (1960) interpre- 
ted the common factors in measures of learning and of aptitude and achieve- 
ment as being dependent upon the similarity of the psychological processes 
and the contents of the material involved in the various learning tasks or 
references variables. 
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Traditionally, studies of abilities and learning have attempted 
to establish direct relationships between these two domains by utilising 
various factor-analytical techniques- This approach has the disadvantage 
of, in many cases, not establishing clearly the relationship between abili- 
ties and learning. An alternative approach to this is to posit the existence 
of a third domain: processes common to both learning and abilities. Psy- 

chologically, it may be possible to conceive of the ability tests as being 
a composit of small concept learning tasks. This is true of Induction and 
General Reasoning tests, and it may also be the case, in general, for tests 
of known cognitive abilities. 

The major difference between tests of abilities and concept- 
learning tasks appears to concern the feedback mechanism. In concept- 
learning tasks, feedback is usually supplied, whereas in ability tests, 
the feedback mechanism is generated by the subject. If, then, ability tests 
and concept-learning tasks are both similar forms of learning tasks, it 
would seem appropriate to examine their relationship by examining the 
processes common to both. 

If a process domain could be established, it is hypothesized that 
it would consist of several relevant cognitive processes that would be simi- 
lar to those the subject must execute in performance on both concept-learning 
tasks and ability tests. The advantages of working with process measures 
would be: (1) to reduce the entire single domain of ability measures to a 

relatively small number of cognitive process measures, and (2) that after 
having established this, to construct models of a mathematical nature that 
would incorporate structures similar to those of cognitive processes. If 
this were done, it would allow the investigator to examine the role of indi- 
vidual difference parameters in concept learning. 

A general outline is proposed to explain how a domain of cognitive 
processes might' be constructed, and the cognitive ability of Induction is 
used as an example. If several measures of Induction were examined with 
respect to the processes the subject must perform to attain an adequate 
score on the ability measure , several specifiable cognitive processes could 
be isolated. Different measures, of these processes could then be constructed. 
These measures would be constructed such that they would be as similar as 
possible to the original ability measure; that is, they would be specific 
to the processes relevant to that original ability test and would contain 
the same content material. 

In constructing such measures, they would be uni vocal with respect 
to the cognitive processes necessary for performance on the ability test. 

If this same type of analysis were undertaken with respect to the concept- 
learning task to be used, measures of processes relevant to the concept- 
learning task could also be constructed. If these new measures were then 
factor-analyzed, the resulting factor structure would be an indication of 
the process common to the Induction ability and the concept -learning task. 

If this same type of procedure were carried out with respect to a wide 
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range of ability measures and concept-learning tasks, it would then be 
possible to establish a domain of cognitive processes that are common to 
both abilities and concept-learning tasks. This procedure is depicted 
schematically in Figure 1. Note that the transitions from the known ability 
tests to univocal ability process tests are rational. An analytic process 
must be employed by the perceptive and experienced experimenter. The same 
is true in obtaining the univocal process measures from the learning tasks . 
Here, one is assisted by empirical confirmation , such as the series of 
studies previously described related to the analysis of multiple-category 
problems in different stages. Experimental manipulation of variables effect- 
ing hypothesized information processing by subjects is a powerful technique 
to aid the search for construct validity. 

While obtaining uni vocal process measures, primarily by rational 
analysis, one is assisted in his search for process constructs common to 
both domains by the technique of factor analysis. Dimensions thus obtained 
can be used in experimental studies in the same way that conventional apti- 
tude measures are now used but with greater expectation of interpretation 
and generalizeable results. 

Pursuant with the logic in Figure 1, studies were undertaken to 
examine the relationship between abilities and performance on concept-learning 
tasks in terms of the similar cognitive processes involved (Costello & 

Dunham, 1971; Costello, 1971). When multiple treatment groups are employed 
instead of a single treatment group, the relationship between an ability 
and performance within any treatment condition may be considered a function 
of an increase or decrease by treatment manipulation in the similarity between 
cognitive processes measured by that ability and those cognitive processes 
necessary to solve the concept tasks. In essence, a treatment manipulation 
defines what processes relevant to solution of the concept tasks in that 
condition are involved. Given the restraings imposed by the treatment mani- 
pulation, the relationship between abilities and performance is a reflection 
of how well ability tests measure cognitive processes similar to those in- 
volved in concept learning. 

This analysis of the relationship between abilities and performance 
on concept-learning tasks is especially useful with abilities that show 
strong relationships to performance under several different treatment condi- 
tions. If an ability relates strongly to performance across several treat- 
ment groups, it does not necessarily imply that the relationship is the same. 
The ability of induction, for example, has been shown by Dunham and Bunder- 
son (1969) to have emerged as a general factor and to contribute strongly to 
performance under two different conditions. Traditionally, this would be 
interpreted as an implication that induction is important to concept learning. 
If concept-learning studies are considered to be concerned with the individ- 
ual's induction of the rules of belonging and not belonging, it is not sur- 
prising then to find that induction has a strong relationship to performance 
under different conditions. To say that induction and concept-learning are 
highly related provides no further information about their relationship. It 



23 



0 

ERIC 



27 



FACTOR ANALYSIS YIELDS: 



V 

Incellectual Processes 
Common to Ability and 
Concept Learning Task 




Tests constructed from 
a rational information 
] processing analysis of 
ability tests. 



Tests constructed from 
a rational information 
processing analysis of 
concept learning tasks. 




Figure 1. — An example diagram of an approach for the investigation of 
intellectual processes common to mental ability tests and 
learning tasks. 
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may be possible that different cognitive processes, as measured by complex 
tests of induction, relate differentially to performance in different 
treatment conditions. This type of knowledge would increase understanding 
concerning the relationship of induction to performance on concept- learning 
tasks. 

A preliminary study was undertaken to investigate the concept 
that known ability tests are composed of specifiable cognitive processes. 
The general approach was to examine the known tests that define a specific 
ability, with respect to the cognitive processes the subject must perform 
in order to attain an adequate score on that ability. In a study reported 
in Costello and Dunham (1971) , such an analysis of the induction factor 
was undertaken. 

The French Kit of Reference Tests for Cognitive Factors defines 
induction primarily by two tests: Locations Test and Letter Sets. With 

respect to the cognitive processes that the subject must; perform, prelimi- 
nary analyses of these two tests revealed three hypothesised cognitive 
processes: hypothesis generation, evaluation, and memory for generated 

hypotheses. Two measures for each of the processes were constructed. 

The subjects were 75 undergraduates from introductory educational 
psychology classes at The University of Texas at Austin. The battery of 
cognitive tests was selected from the Kit of Reference Tests for Cogniti re 
Factors and from Guilford's Structure-of-Intellect Model (Guilford, 1967). 
In addition, all subjects were administered two tests for each of the 
hypothesized cognitive processes: hypothesis generation, evaluation, and 

memory. 

The factor analysis revealed three factors which coincided with 
the hypothesized- cognitive processes of evaluation, hypothesis generation, 
and memory. The high multiple R's for the induction tests, using only the 
factor scores as predictors, seem to imply that the hypothesized cognitive 
processes. raa.y, in fact, adequately describe the processes needed to account 
for performance on tests such as Letter Sets and Locations. Measures for 
mental abilities, such as General Reasoning, Associative Memory, and Flexi- 
bility of Closure, were included to determine whether measures of cognitive 
processes would have a relationship with tests other than those of induc- 
tion. The multiple R^s for these measures, although generally not as high 
as those,. for induction, suggest that other mental ability tests may also 
have specifiable component processes . 

The two tests from Guilford's Structure-of-Intellect Model are 
tests of cognition for semantic classes and of divergent production of 
semantic, classes. The multiple R's for these tests also imply that indi- 
vidual variation on ability tests may be, in part, a function of individual 
differences, with respect to some specifiable cognitive processes. 
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A preliminary investigation of this type iz not offered as con- 
clusive evidence that abilities are composed of specifiable cognitive 
processes. It does, however, suggest that across a diverse range of mental 
abilities, there is a substantial relationship between abilities and measures 
of cognitive processes. This then implies that, in studying the relationship 
between abilities and performance on concept-learning tasks, it may be un- 
necessary to administer large batteries of ability tests. Rather, than be- 
havior being described by a battery of ability tests, it may' be adequately 
described by a fev; measures of cognitive' processes . If this is the case, 
then abilities could he understood in terms of their component cognitive 
processes, and theories of concept learning could be formulated describing 
performance as a function of several cognitive processes. This would then 
allow the investigation of individual difference parameters within a concept- 
learning model. 

In most studies involving concept-learning tasks, the dimensions 
of the task are specified to the subject. This has the effect of limiting 
the number of possible hypotheses with which subjects must deal. If such 
studies are concerned with the processes relevant to the induction of a 
class concept, then limiting the number of possible hypotheses lessens the 
role of processes necessary to the generation of hypotheses. In the study 
reported by Dunham and Costello (1971) , the concept-learning task was con- 
structed such that the dimensions were not previously specified and there- 
fore would not restrict the number of possible hypotheses. 

These concept-learning problems can be solved by forming hypothe- 
ses with respect to other instances of the concept. The subjects first 
must form and then must use these hypotheses to attain the correct concept. 

It was hypothesized that different experimental treatment manipulations, 
such as the availability of possible hypotheses, would alter the relation- 
ship between performance on the concept-learning problems and the cognitive 
process measures. 

Measures for the three hypothesized cognitive abilities, along 
with eight concept problems, were administered to 118 subjects who were 
students at The University of Texas at Austin. The subjects were randomly 
assigned to two groups (1) Relevant hypotheses were provided for the first 
four concept problems (hypothesis-supplied) , and (2) no such provision was 
made (no-hypothesis supplied). Instructing a group of subjects to use 
hypotheses relevant to attaining solutions in a series of concept problems 
did contribute significantly to their meah performance when compared to a 
group that was not given the hypotheses. 

it was hypothesized that the availability of possible hypotheses 
should both* minimize the role of tile cognitive ability of hypothesis genera- 
tion and should place a' greater emphasis on the role of evaluation of the 
given hypothesis. In the no-hypothesis supplied condition, the subjects 
must generate their own hypotheses about the nature of the solution, thereby 
placing a greater importance on the cognitive ability of hypothesis generation. 
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The results suggest that subjects attaining solution in one of 
the two conditions had different cognitive ability profiles. This was 
supported by the discriminant analysis of subjects who attained solution 
in both conditions. Therefore, it seems apparent that the manipulation of 
availability of hypotheses resulted in a change in the nature of the 
information processing which occurred in the two groups. This change then 
became manifest in the relationships of performance to process measures. 

The advantage of using constructs, such as hypothesis generation 
and evaluation, as cognitive abilities is that they allow the researcher 
better understanding concerning which cognitive processes are involved in 
well-established measures of abilities, such as . induction , This, in turn, 
provides a vehicle for interpreting. , the relationships betv/een known cogni- 
tive abilities and performance on learning tasks. Previous studies of this 
type have shown induction to emerge as a general factor and probably to 
be more indicative of some overall level of performance. Also, in most 
studies of abilities and their relationships to learning, induction has 
been shown to have a strong relationship to different treatment groups 
within the same experiment. Unfortunately, this has forced researchers to 
pay attention to abilities that exhibit weaker relationships to learning 
when these relationships vary between treatment groups . 



Toward a Hypothesis Construction Model of Concept Identification 

Most we 11 -developed theories of concept learning have dealt with 
the simplest of concept problems. In particular, the mathematical theories 
have primarily been concerned with the two-category unidimensional problems . 
These problems are quite easy for human subjects, thus placing little demand 
on intellectual abilities. Since the theories have been quite successful 
with simple problems, an effort was undertaken to expand these theories in 
order to describe the performance in more complex concept-learning situations. 
In these situations, it was felt that there would be more demand on the 
cognitive apparatus of the subject, and individual differences would have to 
be taken into consideration. The assumption here is that as theories of 
simple learning are expanded to more., complex problems, learning must be 
expressed as a function of individual difference parameters representing 
human abilities. 

The first effort in this direction concerned a definition for 
which type of theory was more relevant to describing more complex concept 
learning. Information-processing theories of problem solving may be 
divided into too classes. (1) The first assumes that subjects enumerate 
all possible solutions and then use a set of procedures to find the correct 
solution. (2) The second assumes that subjects employ a set of processes 
(heuristics) to construct possible solutions to the problem by basing their 
solutions on the kind and amount of information available at that time. The 
subject then evaluates the adequacy of the tentative solutions. 
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Poison and Dunham (1970) classified theories of concept learning 
along these lines into hypothesis -sampling models and hypothesis -construc- 
tion models. They demonstrated that, as the number of* values on a dimension 
increases, a hypothesis construction theory is necessary to explain the 
data. 



The next effort related to theories of concept learning in this 
vein concerned the development of a hypothesis construction (HC) theory. A 
tentative version of an HC model, developed by Reeve, Poison, and Dunham 
(1970) , makes the following assumptions about the learning of unidimensional 
multiple -category concept problems : 

( 1 ) On the initial trial* and on any other trial where he 
resamples* the subject selects from the set of all dimensions * a subset 
of dimensions to which he attends . As in the Trabasso and Bower (1968) 
theory, the selection mechanism is assumed to be a random- sampling process 
in which the probability of sampling any dimension is a function of the 
salience of the dimension. 

(2) All values of the sampled dimension are summed not to be 
conditioned immediately following sampling . On the trial in which sampling 
occurred, or on any other trial, the feedback is conditioned with probability 
6 to all current unconditioned values of the attended-to dimensions. 

Trabasso and Bower (1968, Chap. 2) assume that the subject alter- 
nates between a search mode and a test mode of operation. In the search 
model, the subject selects a set of hypotheses consistent with current 
feedback. The subject then shifts to a test mode for the next stimulus in 
the series. In the multiple-category problem, this distinction cannot be 
sharply defined. Rather than sampling hypotheses, the subject samples 
dimensions and then constructs hypotheses consistent with the feedback 
given with each instance. He may have the opportunity to test the partial 
hypothesis prior to completely specifying it. 

On any trial, the subject is confronted with a complex and possibly 
conflicting stimulus pattern to which to respond. The value of each of the 
sampled dimensions may be conditioned to any of the n_ responses , or : it may 
be unconditioned* Consistent with Trabasso and Bower (1968) , the response 
rule to be assumed is as follows: When presented with a situation where 

all values are conditioned to a common response, the subject makes the 
response. In any other situation, one value is- picked at random, and the 
subject makes the response associated with' the sampled value. If that value 
is unconditioned, the subject guesses with each of the responses having 
equal' probability of occurring. ■ 

The final process is for eliminating dimensions from the focus 
samp].e. Again following. Trabasso (1968) , it is assumed that an error of 
commission leads the subject to resample. When the subject is responding 
for a reason and is correct, those dimensions whose values were associated 
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with incorrect responses are eliminated from the sample. Trabasso and 
Bower did not have to deal with the third possible outcome , where the subject 
guesses, it is assumed that regardless of whether or not he guesses cor- 
rectly, the action is tie same as when, the subject is correct for a reason. 
Those dimensions leading to an error of commission are eliminated from the 
sample. 



The HC model with the attentional and focusing assumptions can 
be summarized briefly as follows: (1) The subjects current state is 

characterized by his current sample and the response (if any) associated 
to each value of each dimension of his sample. (2) The subject changes 
state by associating responses to values previously unconditioned, eliminat- 
ing dimensions from the sample, or resampling. (3) When one or more uncon- 
ditioned values are presented with feedback, the feedback is conditioned 
to these values with probability 0. (4) When the subject makes an error of 

commission, he resamples, h sample of dimensions is chosen, with replace- 
ment, from the set of all dimensions. The probability of choosing any dimen- 
sion is a function of its salience. (5) When the subject makes a correct 
response or is guessing, dimensions having values conditioned to an incor- 
rect response are dropped, from the sample. (6) On any trial, the probability 
of each response is proportional to the number of values conditioned to that 
response. Any unconditioned value is assumed to contribute equally to the 
probability of each n_ responses. 

Preliminary testing of this model appears in Reeve (1971). A 
refined and more explicit version of the above summary may be found in this 
report. 



(3) A third effort concerned transfer within this theoretical 
frame . The models discussed are information-processing models. Instruc- 
tion effects are of central importance for information processing models of 
transfer. Poison and Dunham (1970) investigated the effects of instruc- 
tions within a variety cf concept-learning transfer paradigms. They con- 
cluded that transfer performance is a function of instructions at the transfer 
point and of the instructions prior to original learning, as well as the type 
of transfer paradigm. They conclude that information processing models assume 
that transfer performance is determined by the type of information processing 
strategies that the subject employs during the initial trials of the trans- 
fer task. The strategies that the subject uses, are determined by the nature 
of the transition (i.e., the type of transfer paradigm) and the information 
that tiie subject has about the relationship between the two problems. In- 
structions can modify the utilization of these strategies, and thus instruc- 
tions and transfer paradigm may be equally powerful determiners of transfer 
performance. This claim follows from any general information processing 
theory of problem solving. These theories assume that the subject uses 
some subset of a larger collection of information processing strategies to 
find a solution to a problem. Furthermore, we cannot assume that the 
subject will use a fixed set of strategies to solve a given class of problems. 
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Tne effects of nonspecific transfer, instructions, and pretraining imply 
that these variables cause, qualitative differences in performance and that 
the subject changes the set of currently active strategies as a function 
of experience and/cr additional information about the task. 



Extensions of the Methodology 

A study was undertaken (Hollen, 1^70) to investigate the 
roles of selected cognitive abilities in obtaining information from passages 
of prose materials when the presence and position of adjunct questions 
were varied. Predictions were made that the associative memory ability and 
a postulated chunking memory ability would be related to task performance 
as measured by posttests of retention of information. 

Ability measures, task materials, and a posttest of retention were 
admixiistered to 136 subjects from introductory classes at Sul Ross University 
under three treatment conditions: (1) an adjunct question preceding each 

passage , (2) an adjunct question following each passage, and (3). no adjunct 

question. After random assignment to treatment groups, the subjects were 
further divided into groups for whom English was a primary language and for 
whom it was an acquired language. 

Results indicated that only. the associative memory ability was 
needed for task performance. A reduction in need for the ability in both 
tasks occurred when questions followed passages; no reduction occurred when 
questions preceded passages. 

Disordinal interactions of treatments with associative memory 
observed in this study imx^ly that in the absence of adjunct questions, 
subjects adopted strategies of information processing maximizing the need 
for associative memory, but they changed to strategies minimizing this need 
when questions followed passages. The change in strategies was more appro- 
priate to task performance for subjects low in the ability, less appropriate 
for subjects high in the ability. 

Questions were raised as to the generality of findings from 
previous studies concerning the facilitative effects of adjunct questions. 
Performance of subjects high in associative memory was actually impaired 
by the use of adjunct questions/ A basis for future investigations was 
provided by data from subjects for whom English was an acquired language. 
Results suggest the possibility that such subjects adopt information-processing 
strategies that differ from those adopted by subjects for whom English is a 
primary language. ! 

During the term of this program of research, a number of studies 
were designed to assess the relationship between cognitive abilities and 
performance on various learning tasks. It was repeatedly shown that observed 
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relationships between cognitive abilities and performance vary under dif- 
ferent experimental treatments. Another study (Beyers S Dunham, 1971) 
was undertaken to attempt to broaden the ability by treatment interaction 
paradigm through the examination of anxiety and task involvement as they 
contribute to the relationship between abilities and performance. 

There were four experimental conditions, defined by all combina- 
tions of two types of concept transfer conditions, and two types of ego- 
involvement instructions (high ego-involvement and low ego-involvement) . 

All subjects received two consecutive unidimensional, four-category concept 
problems. The second problem served as the transfer problem. The two trans- 
fer conditions v;ere extradimens ional shifts which differed as to whether 
the dimensions and values of the transfer problem were the same (EDS) as 
those in the original learning problem or if they consisted of new (EDN) 
dimensions and values. Consequently, it v;as expected that, because of nega- 
tive transfer, the EDS problem would involve competing responses, and thus 
anxiety would have a relatively debilitating effect. 

The subjects were 188 introductory educational psychology students 
at The University of Texas at Austin. They were first administered a battery 
of ability tests from the French Kit of Reference Tests. 

Cnange scores (i.e., number of trials to criterion on original 
learning problems; number of trials to criterion on transfer learning problems) 
were employed as the dependent measure to assess transfer. An analysis of 
variance was used to assess the effects of transfer and involvement condi- 
tions . The major findings for this analysis were that the EDS shift was 
significantly more difficult than the EDN shift and that there was no signifi- 
cant difference in the performance of subjects between high and low involve- 
ment instructions. 

A regression analysis was completed in order to assess the inter- 
active effects of anxiety and abilities on performance. Although it was 
reported above that there were no significant differences in performance based 
on "involvement instructions," the significant interactions with anxiety 
and ability variables occurred only with low involvement. Under this condi- 
tion, there was a significant interaction between anxiety and memory span 
for both the EDS and EDN condition. Moreover, the relationship between 
anxiety and performance was relatively debilitating in the EDS when compared 
to the EDN problem. 

The major finding of this study was the interaction between anxiety 
and memory span, which occurred despite the lack of correlation between these 
two variables. This finding implies that anxiety inhibits the utilization 
of the memory-span attitude, and it provides support for the notion that 
not only treatment conditions but also personality and motivational factors 
should be considered v/ithin the aptitude by treatment interaction paradigm. 
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SECTION IV 
EVALUATION AND CONCLUSIONS 



The stragegy on which this project was based was reviewed in the 
first section of this report. It attempts to develop a continuum between 
research , theory, and methodology in the psychological investigation of 
complex human learning and applied curriculum development, primarily for 
CM. This continuum can be represented as follows: 



Body of 

Psychological 

Research, 

Methodology , ++ 

£ Theory 

(Human 

Learning) 



Concept Xenograde 

Learning CAI 

Laboratory Program 

Tasks 



Design Applied CAI 

Model ++ Curriculum 
Development 



Substantive matters within the three middle categories have been reviewed 
within the body of this report,, The purpose of the present section is to 
evaluate the extent to which the transitions between the areas represented 
above occurred. These transitions are represented by arrows. 

Between the body of psychological knowledge in concept learning 
and our laboratory studies, the distance is short, and the integration 
thorough. Guided by Propositions 1, 2, and. 3, discussed earlier in 
Section III, we have, produced steady, and hopefully useful, increments in 
empirical data, methodology, and theory. Most contributions have been 
dependent on the detailed information-processing analysis of concept-learning 
tasks, which is the hallmark of our methodology. This provides a rational 
approach to the identification and interpretation of relevant aptitudes and 
their interactions. It also provides a route to the construction of powerful 
and useful hypothetical constructs. The combination of treatment manipula- 
tion and aptitude . covariation is a useful methodology for establishing con- 
struct validity . It is far stronger than procedures which limit themselves 
to the aptitude or experimental domain exclusively. 

■■ In our estimation, the most important methodological and conceptual 
contribution of this. project is the "process measure" approach described 
in Section III. Not only does this provide a methodology for aptitude x 
treatment studies which promises to be clearer conceptually, but it may 
prove to be an important. step toward the formulation and evaluation of 
hypothesis— cons true tion theories of complex human learning— —theories which 
incorporate ability parameters representative of constructs having a separate 
source of empirical construct validation. 
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VJhile important initial steps toward this goal were achieved 
during the course of this brief project, considerable work remains to be 
done before the "process measure" approach is adequately evaluated. The 
actual extent of its importance must be established by considerably more 
research and more theoretical development. 

The transition between the laboratory research and the Xenogrado 
research fell short of expectations at the operational level • It cannot l e 
said that cross-validation of results between the two classes of learning 
tasks occurred in any important way. This was true even in the simple 
of the role of memory ability as influenced by the availability of preview* 
examples. 



The first problem obstructing operational cross-validation lies 
in the feict, observed by Glaser (1968), that laboratory studies o; concejV: 
learning almost exlusively use an inductive approach. Glaser notes: "It 
seems contradictory that in psychological experiments we have been study iv ; 
just the types of concepts that might best be taught by presenting* the ru3e 
first." 



In addition to the inductive emphasis in psychological research, 
the sequences of examples are usually random or, at best, arbitrary. In 
Xenograde, the most instructionally-effective treatment used an explicit 
rule-example presentation to establish the various relational concepts which 
comprise the Xenograde hierarchy. Sequence was shown to be a powerful in- 
fluence on performance. This method was far more efficient and sometimes 
superior in terms of posttest, retention, and transfer than the inductive 
(discovery) approach using examples only. In this efficient treatment, t ho 
relationship of aptitudes to performance was greatly reduced or eliminated 
altogether,, 

The factors of rule instruction and sequence were not entirely 
ignored in our laboratory research. Decision rule instruction played an 
important role in the studies discussed in Section III. The relationship 
between sequence effects and performance, when strategies using different 
decision rules are considered, was also studied by Blaine and Dunham (3970), 
However, it cannot be said that the most straightfoward and efficient in- 
structional design was ever used in these tasks* 

In one sense, the lack of clear cross-validation between laboratory 
and Xenograde aptitude x treatment studies can be viewed as a "success story 
Prom the instruction design point of view, we have learned how to reduce or 
to remove the constraint on learning associated with low scores on certain 
aptitude tests. This is done in an efficient manner through the use of rule 
example sequences ordered in accord with a cumulative hierarchy. If labora- 
tory concept-learning studies would use these techniques, it would have at 
least two noticeable effects. First, a certain body of research and theory 
would be shown to be irrelevant to human instruction. It would prove to be 
an artifact of keeping subjects in the dark. Second, a relatively untilled 
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that aptitude constraints can be removed or reduced by clear rule -example 
presentation and by the use. of objectives has been translated into some CAI 
computer programs. Techniques of learner control over sequence and display 
variables have been incorporated into some CM programs and are being 
evaluated (Judd , Bunderson, & Bessent, 1970). . 

The instructional design model has evolved substantially during 
the course of this research program. There is a good match between the 
design products and possibilities for experimental manipulation in the 
Xenograde programs and the categories of . the instructional design model. 

On the negative. side, /the imaginary nature of Xenograde has limited the 
generality of results obtained through use of this task. Some students are 
not interested, in learning an imaginary science. However, since some stu- 
dents are not interested t in learning anything difficult, we are not sure how 
far our results have been biased. 

Originally, the imaginary character of Xenograde \*as felt to be 
useful experimentally since it provided control over prior learning. As so 
often proves to be the case in research, its greatest value was not related 
to this supposed purity from prior knowledge. Prior experience with quanti- 
tative rules, numerical tables, and "scientific thinking" was not controlled 
by the unfamiliar content. The great utility of the imaginary task proved 
to be in freeing the experimenter-instructional designers from concern about 
related scholarship, teaching traditions, etc. It thus became possible to 
cpncentrate on questions of task structure, sequence, and display without 
being .constrained by other concerns. ; When some characteristic of the task 
hindered experimental objectives or efficient instruction, the laws of the 
"science" could be changed. , . 

Another advantage of Xenograde was the conscious attempt to link 
the Xenograde program to the real tactical needs of the instructional designer. 
This program was designed following the guidelines laid down by the model. 

It thus miderwent extensive revisions on the basis of feedback from students 
in the early studies. 

v The importance, of revision based on student , feedback cannot be 
over i st ^® sse ^*. i As discussed in Section II, the gain in instructional effec- 
t i vene s s* due to re vis ion may be greater than the gain possible as the result 
of branching to an alternate treatment based on an aptitude score. The same 
statement may be made of an instructional decision based on any other proposi- 
tion. - ' ..... ., , ... 

- in evaluating the transfer between the Xenograde studies and the 
instructional design model , it must be stated that the impact of formative 
evaluation and revision on the relevance of research had c not been fully per- 
ceived. If '^research on cpmplex, tasks does .take place before these tasks are 
tdioroughly tested and revised, it may be in. vain .insofar as relevance is 
concerned • On the other hand , if researchers fully comprehend the decision 
processes of an instructional designer who is faced with data which indicates 
the need for revision, they may be able to develop and validate instructional 
theorems which can guide the revision process. 



It was not the purpose of this research to contribute directly to 
the transfer between the instructional design model and applied curriculum 
development* -In the present project, the ^instructional design model stands 
as a representational scheme .to describe an "engineering discipline" for 
education. It ia- focused primarily at the engineering of high quality CAI 
programs. In order to complete this discussion, something should nonethe- 
less be said concerning the effectiveness of the model in guiding quality 
curriculum development. The empirical proof of this particular "pudding" 
comes through the evaluation of the CAI programs generated by following the 
model (with a large dash of taste and creativity thrown in to moderate its 
otherwise mechanical prescriptions). The results are most promising: Among 

other topics, the model has been successfully applied to freshman mathe- 
matics (Judd, Bunderson, fi Bessent, 1970), freshman English, computer science 
(Homeyer, 1970), freshman chemistry, and the Arabic writing system (Abboud, 
1970). In the case of the Arabic program, the evaluation results are as much 
or more a vindication of the instructional design. model as. of CAI* Abboud's 
instructional design thoroughly restructures the current pedagogical pro- 
cedures for the Arabic writing system in a manner only partially dependent 
on a CAI implementation. An evaluation study has revealed that classroom 
instruction extending over six weeks, six hours per week, in Arabic can be 
replaced by from five to ten hours at the CAI terminal. Contrary to class- 
room instruction, attrition rate is very low or nonexistent* Attitudes are 
very positive, performance scores are significantly higher than in classroom 
instruction, and apparent transfer to later classroom work is greater. 

In conclusion, this section has attempted to evaluate the feasibil- 
ity of a strategy which seriously tried to provide a series of links between 
practical questions of instructional design and a science of human learning. 
The conclusions of this evaluation can be summarized in terms of two rubrics: 
operational cross-validation and metaphorical transfer. 

At the level of operational cross-validation between laboratory 
tasks and instructionally-oriented tasks, this strategy did not succeed 
during the two years allotted to this project. There is no evidence that it 
cannot succeed, if given more time, given a conscious recognition of the 
difficulty of the endeavor, and given a recognition of the possibility that 
the methods, paradigms, and models of psychological research can be modified 
to be more relevant to instructional theory. 

To be more relevant to instruction, the psychological study of 
concept learning could incorporate the following suggestions: 

(1) It should investigate behavior under expository as well as 
inductive presentations. Complex and cumulative sequences of concepts should 
be investigated. 

(2) It should consider more carefully seemingly microscopic 
sequence effects between adjacent concept exemplars. Stated alternately, it 
should investigate the manner of constructing adjacent and near-adjacent 
examples and non-examples to take advantage of design strategies. 
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(3) Cognitive aptitude covariables should be incorporated in 
experimental designs , but as "process measures 11 rather than strictly in the 
form of more traditional tests. In computer-based research/ aptitudes may 
be measured on-line and as a subtle part of learning activities themselves. 

In CAI, aptitude parameters should be related to micro -adaptive mechanisms 
(i .e . / control over sequence parameters or display parameters) rather than 

as ; the basis for branching to alternate macro-treatments (alternate programs). 
Aptitude x aptitude x treatment interactions should be studied as well as the 
case with 'single aptitudes. 

(4) Research should take into . account the payoff from an instruc- 
tional decision relative to the payoff from revision . of the lesirning task. 
Whether based on an individual aptitude parameter or an implied group mean 
difference, an instructional decision may produce! a less significant effect 
than revision. Revision may be less costly than the research, or it may 
alleviate the need for the decision. Improvement through revision may be 
due to a series of minor modifications, made at points where feedback from 
students has revealed deficiencies, or it may be based on a restructuring 

of an important variable which runs throughout the , treatment . ” 

A corollary to this last guideline is that tasks used in human 
learning research should reach an asymptote in effectiveness produced 
through formative evaluation and revision before lavishing the money, time, 
and talent of a research establishment on them. ' ' 

At the level of metaphorical transfer of the procedures, tactics, 
and conceptual approaches, the project rates more highly, ^ome. important 
ideas which reverberated throughout all aspects of the project are the’ ideas 
of information-processing task analysis, "process measures" for aptitudes, 
and aptitudes as parameters having independent construct validity,, In addi- 
tion to these instances of positive transfer, the strategy permitted the 
identification of exactly where transfer was hindered, due to different 
emphasis or procedures in laboratory and instructional research. 
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A P P E N D I X 

PUBLICATIONS OR PAPERS RESULTING FROM WORK CONDUCTED UNDER ARPA CONTRACT 
Technical Reports 



Tech 1 


Dunham* J. L., & Bunderson, C. V. Effect of decision rule instruc- 
tion upon the relationship of cognitive abilities to perfor- 
mance in multiple-category concept problems, 1971. 


Tech 2 


Bunderson, C. V., & Merrill, P. P. The design of an abstract 

hierarchical learning task for computer-based instructional 
research, 1971. 


Tech 3 


Bunderson, C. V., Merrill, P. F. , & Olivier, VJ. P. The interaction 
of reasoning and memory abilities with rule-example vs. dis- 
covery instruction in learning an imaginary science, 1971. 


Tech 4 


Olivier, W. P. Program sequence by ability interaction in 

learning a hierarchical task by computer-assisted instruction, 
1970. 


Tech 5 


Merrill, P. F. Interaction of cognitive abilities with availability 
of behavioral objectives in learning a hierarchical task by 
computer-assisted instruction, 1971. 


Tech 6 


Bunderson, C. V., & Hansen, J. B. The interaction of associative 
memory and general reasoning with availability and com- 
plexity of examples in a computer-assisted instruction 
task, 1971. 


Tech 7 


Blaine, D„ D. f & Dunham, J. L. Strategy instruction and type of 
sequence in concept attainment, 1971. 


Tech 8 


Overstreet, J. D. The roles of stimulus complexity and information 
processing rules within two phases of multiple-category 
attainment, 1971. 


Tech 9 


Blaine, D. D., & Dunham, J. L* The effect of availability on 
the relationship of memory abilities to performance in 
multiple-category concept tasks, 1971. 


Tech 10 


Dunham, J. L., & Poison, P. G. Theories of unidimensional concept 
identification, 1971. 


Tech 11 


Meyers, J., & Dunham. J. L. an investigation of the effects of 
anxiety, abilities, and task characteristics on concept 
learning, 1971. 
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Tech 12 



Dunham, J. L., & Blaine, D. D. The relationship of abilities to 
different stages of concept attainment, 1971. 

Tech 13 Dunham, J. L., & Costello, R. J. Intellectual processes in 
concept learning, 1971. 

Tech 14 Poison, P. G. , Dunham, J. L . , & Reeve, M. B. Effects of instruc- 
tions on performance in three shift paradigms, 1971. 



Technical Memos 

Systems Memo 1 Smith, A., Wheaton, M., Gregory, C., & Bunderson, C. V. 

1. Ccurse\/riter II function (fcalc) for the manipula- 
tion of numerical and algebraic expressions, 1970. 

Systems Memo 2 Wheaton, Groom, V., & Bunderson, C. V. .Coursewriter II 

functions for the generation and display of plots 
and other graphics, 1970. 



Articles Published in Journals 



Blaine, D. D„‘, & Dunham, J. L, The effect of availability on the relationship 
of memory abilities to performance in multiple -category concept tasks. 
Journal of Educational Psychology , 1971. (in press) 

Dunham, J. L , , & Bunderson, C. V. Effect of decision-rule instruction upon 
the relationship of cognitive abilities to performance in multiple- 
category concept problems. Journal of Educational Psychology , 1969, 
60(2), 121, 125. 



Articles Published in Formal Proceeding s 

Bunderson, C. V. Justifying CAI in mainline instruction. In Proceedings of 
the Conference on Computers in the Undergraduate Curricula . Sponsored 
by the National Science Foundation. Gerard P. Weeg (Conference 
Organizing Committee Chairman). Iowa City: The University of Iowa, 

June, 1970. 

Bunderson, C. V. Instructional software engineering. In-Blum, R. (Ed.). 
Proceedings of the Conference on Computers in Undergraduate Science 
Education . College Pork, Maryland: Commission on College Physics, 

University of Maryland, 1971. (in press) 
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Dissertations 



Blaine, D. D.. Process measures for concept learning. In progress. 

Costello, R. J. The role of inductive reasoning processes in concept learning. 
In progress. 

Hollen, T. T. Interaction of individual abilities with the presence and 

position of adjunct questions in learning from prose materials, 1970. 

Merrill, P. F. Interaction of cognitive abilities with availability of 
behavioral objectives in learning a hierarchical task by. computer- 
assisted instruction, 1970. 

Meyers, J. An investigation of the effects of anxiety, abilities, and task 
characteristics on concept learning , .1971 . 

Olivier, W. P. Program sequence by ability interaction in learning a 
hierarchical task by computer- as sis ted instruction, 1970. 

Overstreet, j. D.. , The roles of stimulus complexity and information processing 
. rules within two phases of multiple-category concept attainment, 1970. 

Reeve, 14. B. A theory of multiple -category concept identification. 

In progress . * < ■ 



Papers Read at Professional Meetings 

Blaine, D. D., £ Dunham, J; L. The effect of available instances on the 

relationship of memory abilities to performance in a concept learning 
task. Paper presented ap the annual meeting of the American Educa- 
tional Research Association, Los Angeles February, 1969. 

Blaine, Dv D. , & Dunham, J. L. Strategy * instruction and type of sequence in 
concept attainment* Paper presented at the annual meeting of the 
. American Educational Research Association, Minneapolis, March, 1970. 

Bunderson, C. V. Ability by treatment interactions in designing instruction 

for a hierarchical learning task. Paper presented at the annual meeting 
of the American Educational Research Association, Los Angeles, February, 
1969. 

Bunderson, C. V. Aptitude by treatment interactions: of what use to the 

instructional designer? Paper presented at the annual meeting of the 
American Psychological Association, Washington, D.C., September, 1969. 

Bunderson, C. V. Aptitude by treatment interactions: old problems, new ap- 

proaches, recent data. Discussion group chaired by Robert Glaser at the 
annual meeting of the American Psychological Association, Miami, 
September, 1970. 
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Costello, R. J., & Dunham, J. L. Inductive Reasoning processes in concept 

learning. Paper presented at the annual meeting of the American Educa- 
tional Research Association, flew York City, February, 1971. 

Dunham, J. L. Investigations of the role of intellectual abilities in concept 
learning. Paper presented at the annual meeting of the American Educa- 
tional Research Association, Los Angeles, February, 1969. 

Hansen, J. B., & Bunderson, C. V. The interaction of associative memory and 

general reasoning with ability and complexity of examples in a computer- 
assisted instruction task. Paper presented at the annual meeting of 
the American Educational Research Association, New York City, February, 
1971. 

Merrill, P. F. Designing and developing an imaginary science program in in- 
structional design and theory. Paper presented at the meeting of the 
Association. for the Development of Instructional Systems, Los Angeles, 
February, 1969. 

Meyers, J., & Dunham, J. L. An investigation of the effects of anxiety, 

abilities and task characteristics, on concept learning. Paper presented 
at the annual meeting of the American Educational Research Association, 
New York City, February, 1971. 

Overstreet, J. D., & Dunham, J. L. Stimulus complexity and information pro- 
cessing rules in multiple-category concept identification. Paper pre- 
sented at the annual meeting of the Southwestern Psychological Asso- 
ciation, St. Louis, April, 1970. 

Poison, P. G . ,■ & Dunham, J. L. A comparison of two types of theories of mul- 
tiple-category concept identification. Paper presented at the annual 
meeting of the Mathematical Psychologists Conference, Indiana University, 
Bloomington,. April, 1970. 

Poison, p. G., Dunham, J. L., & Reeve, M. B. Effects of instructions on 

performance in three concept shift paradigms . Paper presented at the 
annual meeting of the Midwestern Psychological Association, Cincinnati, 
1970 . " - 

Wheaton, M. Use and design of the plot function. Paper presented at the 

meeting of the Association for the Development of Instructional Systems, 
New York City, March, 1970. 
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Table 1 



Summary of Research Conducted Wholly or Partially Under ARPA Contract 



Study or Activity 



Code* Products Completed 



I. Studies Related to Use of Xenograde Program 

A. Discovery vs. Expository Treatments 

— and Simulation FP Discussed in Bunderson (1971) 

— General Reasoning, Memory, T3 Bunderson, Merrill, & Olivier (1971) 

Induction 

— Reasoning and Performance Dis , Merrill (1970) 

Objectives T5 Merrill (1970) 

— Memory and Availability T6, Bunderson & Hansen (1971) 

PS Hansen. & .Bunderson (1971) 

B. Sequence & Learner Control *Dis, Olivier (1970) 

T4 Olivier (1971) 

II. Instructional Design and CAI 

A. Instructional Design Implications 



— Design and Documentation 


PS 


Merrill (1969) 


of Xenograde Program 


T2 


Bunderson & Merrill (1971) 


— Aptitude X Treatment 


PS 


Bunderson (AERA, 1969) 


Interactions and 


PS 


Bunderson (APA, 1969; 1970) 


Instructional Design 






— Instructional Design 


FP 


Bunderson (1970a, 1970b) 


Model 

— Algorithmic Analysis for 




Merrill (1971) 



Learning Hierarchies 
B. Program Documentation 



— Mathematical Response 
Analysis Function 


TMl 


Smith et 


al. (1970) 


— Plot Functions 


TM2 , 


Wheaton 


et al. (1970) 


* 


PS 


Wheaton 


(ADIS, 1970) 



III. Studies Employing Laboratory Tasks 



A. Analysis of Learning Stages and Decision Rules. 



— Decision Rules G 
Learning Stages 



PS, Overstreet & Dunham (SWPA, 1970) 
Dis, Overstreet (1970) 

T8 Overstreet (1971) 



Table 1 (continued) 



Study or Activity 



Code Products Completed 



III. 



B. Decision Rules and Concept Learning Identification 



Decision Rule Instruction 
and Aptitudes 


Tl, 

JA 


Dunham 


& 


Bunderson (J.Ed.P., 1969) 


- Decision Rules , Learning 


PS, 


Dunham 


(AERA, 1969) 


Stages & Aptitudes 


T12 


Dunham 


St 


Blaine (1971) 


— Sequence Effects & 


PS, 


... Blaine 


& 


Dunham (AERA, 1970) 


Decision Rules 


T7 


Blaine 


& 


Dunham (1971) 


Availability of Instances 


PS, 


Blaine 


& 


Dunham (AERA, 1969) 


& Memory 


JA, 


Blaine 


& 


Dunham (J.Ed.P., 1971) 




T9 


Blaine 


& 


Dunham (1971) 



D* Process Measures for Aptitude a Learning 



-Relationship of Conceptual Dis 
Task, Test, & Process 
Measures 

•Intellectual Processes in PS 
Inductive Reasoning a 
Concept Learning 
■Intellectual Processes in T13, 
Concept Learning Dis 



Blaine (1971) 

Costello & Dunham (AERA, 1971) 

Dunham & Costello (1971) 
Costello (1971) 



E. Toward A Hypothesis Construction Model of Concept Identification 



■Comparison of Two Types PS, 

of Theory T10 

•Instructions & Transfer PS, 

in Concept Shift T14 

■Theory of Multiple- Dis 

Category Concept 
Identification 



Poison & Dunham (MPC, 1970) 

Dunham & Poison (1971) 

Poison, Dunham, & Reeve (MPA, 1970) 
Poison, Dunham, & Reeve (1971) 

Reeve (1971) 



F . Related Research 

— Adjunct Questions & Memory Dis Hollen (1970) 

Anxiety &. Aptitude PS, Meyers a Dunham (AERA, 1971) 

Interaction J Til, ..,Meyers (1971) 

Dis Meyers (1971) 



*Code Abbreviations: Tn Technical. Report Number 

TM = Technical Memo 
Dis = Dissertation 
. JA = Journal Article 
j.Ed.P. = Journal of Educational Psychology 
FP = Articles in Formal Proceedings 

PS « Paper Presented at Meeting of Professional Society 
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